o\ - R -oo 



PATENT 
Docket No. 1232-4607 
Express Mail Label No. EJ606954024US3 

IN THE UNITED STATES PATENT AND TRADEMARK OFFICE „'|p 

UTILITY APPLTCATTON AND APPLICATION FEE TRANSMITTAL (1.53(h))o gl 

U 

ASSISTANT COMMISSIONER FOR PATENTS 
Box Patent Application 
Washington, D.C. 20231 

Sir: 

Transmitted herewith for filing is the patent application of 
Named Inventor(s) and 

Address(es): Masami SUGIMORI, 9-15-602, Shimotsuruma 2-chome, Yamato-shi, Kanagawa-ken, 

Japan 

For: IMAGE SENSING APPARATUS AND IMAGE PROCESSING METHOD 

THEREFOR 

Enclosed are: 

[X] 48 page(s) of specification, _1_ page(s) of Abstract, 22. jpage(s) of claims 

[X]_21 sheets of drawing [X ] formal [] informal 

[ ] _ Page(s) of Declaration and Power of Attorney 

[ ] Unsigned 

[ ] Newly Executed 

[ ] Copy from prior application 

[ ] Deletion of inventors including Signed Statement under 37 C.F.R. § 1.63(d)(2) 

[X] Incorporation by Reference: The entire disclosure of the priority applications) identified below, is 

considered as being part of the disclosure of the accompanying application and is incorporated herein by 
reference. 

[ ] Microfiche Computer Program (Appendix) 

[ ] page(s) of Sequence Listing 

[ ] computer readable disk containing Sequence Listing 

[ ] Statement under 37 C.F.R. § 1 .821(f) that computer and paper copies of the Sequence Listing are 
the same 

[X] Claim for Priority Japanese Application Nos. 11-012339 filed 1/20/99: 11-012338 filed 1/20/99: 11- 
053383 filed 3/1 /99: and 1 1-053384 filed 3/1/99 



515679_1 



Docket No 1232-4607 



[ ] Certified copy of Priority Documents) 
[ ] English translation documents 

[ ] Information Disclosure Statement 

[ ] Copy of Cited references w/ English Abstracts 

[ ] Copy of PTO-1449 filed in parent application serial No. , 

[ ] Preliminary Amendment 

[X] Return receipt postcard (MPEP 503) 

[ ] Assignment Papers (assignment cover sheet and assignment documents) 

[ ] A check in the amount of $40.00 for recording the Assignment. 

[ ] Assignment papers filed in parent application Serial No. . 

[ ] Certification of chain of title pursuant to 37 C.F.R. § 3.73(b). 
[ ] This is a [ ] continuation [ ] divisional [ ] continuation-in-part (C-I-P) of prior application serial no. 

[ ] Cancel in this application original claims of the parent application before 

calculating the filing fee. (At least one original independent claim must be retained for filing 
purposes.) 

[ ] A preliminary Amendment is enclosed. (Claims added by this Amendment have been properly 
numbered consecutively beginning with the number following the highest numbered original 
claim in the prior application. 

[ ] The status of the parent application is as follows: 

[ ] A Petition For Extension of Time and a Fee therefor has been or is being filed in the parent 

application to extend the term for action in the parent application until . 

[ ] A copy of the Petition for Extension of Time in the co-pending parent application is attached. 

[ ] No Petition For Extension of Time and Fee therefor are necessary in the co-pending parent 
application. 

[ ] Please abandon the parent application at a time while the parent application is pending or at a time when 
the petition for extension of time in that application is granted and while this application is pending has 
been granted a filing date, so as to make this application co-pending. 

[ ] Transfer the drawing(s) from the patent application to this application. 

[ ] Amend the specification by inserting before the first line the sentence: 

This is a [ ] continuation [ ] divisional [ ] continuation-in-part of co-pending application Serial 
No. filed . 

-2- 



515679J 



Docket No 1232-4607 



CALCULATION OF APPLICATION FEE (For Other Than A Small Entity) 











Basic Fee 




Number Filed 


Number Extra 


Rate 


$ 690.00 


Total 
Claims 


61 


-20= 41 


x$ 18.00 


$ 738.00 


Independent 
Claims 


11 


-3= 8 


x78.00 


$ 624.00 


Multiple Dependent Clair 


ns 

[ ]yes 

[X]no 


Additional Fee = 
Add'IFee 


$260.00 
NONE 


$ 0 



Total: $2.052.00 

[ ] A statement claiming small entity status is attached or has been filed in the above-identified 
parent application and its benefit under 37 C.F.R. § 1.28(a) is hereby claimed. Reduced 
fees under 37 C.F.R. § 1.9(F) (50% of total) paid herewith $ . 

[ X] A check in the amount of $2.052.00 for payment of the application filing fees is attached. 

[ ] Charge Fee(s) to Deposit Account No. 13-4500. Order No. . A DUPLICATE COPY OF 

THIS SHEET IS ATTACHED. 

[ X ] The Assistant Commissioner is hereby authorized to charge any additional fees which may be required for 
filing this application, or credit any overpayment to Deposit Account No. 13-4500, Order No. 1232-4607 . 
A DUPLICATE COPY OF THIS SHEET IS ATTACHED. 



Dated: January 18. 2000 



Respectfully submitted, 
MORGAN & FINNEGAN, L.L.P. 




J^fiesHwa 

Legistration No. 42,680 



CORRESPONDENCE ADDRESS 

MORGAN & FINNEGAN, L.L.P. 

345 Park Avenue 

New York, New York 10154 

(212) 758-4800 

(212) 751-6849 Facsimile 



515679J 



TITLE OF THE INVENTION 



IMAGE SENSING APPARATUS AND 
IMAGE PROCESSING METHOD THEREFOR 

5 

BACKGROUND OF THE INVENTION 

The present invention relates to an image sensing 
apparatus such as a digital camera or digital video 

10 camera or the like, and an image processing method for 
the image sensing apparatus . 

A conventional single-plate color digital camera 
is a lens -integrated system , and is generally incapable 
of exchanging a lens. For this reason, an optical low 

15 pass filter and infrared ray (IR) filter or the like 
are provided before a CCD, which generates image 
signals according to light passing through the lens , 
thereby achieving a certain degree of effectiveness in 
reducing moire or pseudo colors (erroneous colors). 

20 However, in a case of a camera which allows lens 

exchange, an IR filter can be provided before a CCD by 
forming a thin film on a glass surface of the CCD. 
However, securing space for an optical low pass filter 
before a CCD causes to increase the size of the camera 

25 body. Furthermore, although such optical low pass 

filter can reduce moire or pseudo colors to a certain 
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degree, a problem arises in that spatial frequency of 
an image decreases , and as a result , the image loses 
exact-focused characteristic such as that obtained in 
silver chloride photographs. Because of the above 
5 reason, the importance of an optical system without an 
optical low pass filter is increasing. 

Furthermore, even if such optical low pass filter 
is provided, in a case of a digital camera employing a 
single-plate CCD, pseudo colors are still generated 

10 when color interpolation is performed. As exemplified 
by the Bayer pattern, when a number of R (red) and B 
(blue) color components is less than that of G (green) 
color components, the gap between these pixels becomes 
large, and this causes generation of pseudo colors in 

15 color interpolation. Furthermore, a method of 

generating three color planes with a digital filter or 
the like is available as a conventional color 
interpolation. However, since the order of the digital 
filter is limited, original image data resolution 

20 cannot be sufficiently expressed. 

In view of the above, conventionally proposed is 
to perform image processing, particularly color 
interpolation, disclosed in US Patent No. 5,373,322 or 
No. 5,629,734, to obtain high resolution image data. 

25 This technique is effective to reduce pseudo colors, 
but not effective for moire . 



Even with the conventional technique, isolated 
pseudo colors, generated particularly around small 
characters or the like, cannot completely be eliminated 
In view of this, it is proposed to convert color space, 
e.g., from RGB to L*a*b*, by an application program 
operating in a computer, and perform processing such as 
filtering on a* and b* to remove pseudo colors. 

However, even if such conventional technique is 
employed, pseudo colors in color interpolation cannot 
completely be eliminated. This is further described 
below. 

As shown in Fig. 19, if vertical white lines are 
exposed to green (G) and red (R) lines of a CCD at 
pixel pitch and conventional color interpolation is 
performed, red (R) and yellow (Y) vertical stripes are 
obtained (in Fig. 19, hatching portion indicates black 
where data is 0). Similarly, as shown in Fig. 20, if 
vertical white lines are exposed to green (G) and blue 
(B) lines of a CCD at pixel pitch and color 
interpolation is performed, blue (B) and cyan (C) 
vertical stripes are obtained. Note that even if the 
stripes in Figs. 19 and 20 are horizontal instead of 
vertical, the same results, i.e., red (R) and yellow 
(Y) stripes or blue (B) and cyan (C) stripes, are 
obtained. 

Furthermore, as another pattern, if white pixels 



having a checker flag pattern shown in Fig. 21 are 
exposed to R and B of a CCD and color interpolation is 
performed, a magenta (M) image is obtained despite the 
original white color. Still further, if white pixels 
having a checker flag pattern shown in Fig. 22 are 
exposed to G of the CCD and color interpolation is 
performed, a green (G) image is obtained despite the 
original white color. 

In order to remove such pseudo colors, the color 
space is converted from RGB to, for instance, L*a*b* 
and filtering is performed on each of the a* and b* 
color spaces by an application program operating in a 
personal computer. However, in the case of checker 
flag patterns shown in Figs. 21 and 22, a low frequency 
image of green cannot be distinguished from that of 
magenta, making it impossible to determine pseudo 
colors . If the frequency band of color difference is 
forcefully limited for JPEG compression, a dull 
(blurred) image is obtained. As a result, although the 
level of pseudo colors is reduced, the pseudo color 
components are spread out to the peripheral pixels, 
causing problems. 

Furthermore, if the image data is compressed 
according to JPEG or the like without performing above - 
described pseudo color removing processing, block noise 
or the like may be caused. Moreover, if the frequency 



band of color difference is forcefully limited for JPEG 
compression, an image becomes blurred. As a result, 
although the level of pseudo colors is reduced, the 
pseudo color components are spread out to the 
peripheral pixels, causing problems. In order to 
eliminate such pseudo colors, it is ideal to employ a 
three-plate camera using three image sensing devices 
for each color component. However, such construction 
increases the size and cost of the camera. 

SUMMARY OF THE INVENTION 
The present invention is made in consideration of 
the above situation, and has as its object to provide 
an image sensing apparatus capable of reducing pseudo 
colors generated by color interpolation, and an image 
processing method for the image sensing apparatus. 

Furthermore, another object of the present 
invention is to provide an image sensing apparatus 
which can reduce pseudo colors without increasing the 
size or cost of the image sensing apparatus, and an 
image processing method for the image sensing apparatus. 

Furthermore, another object of the present 
invention is to provide an image sensing apparatus 
which can reduce pseudo colors with relatively a simple 
construction, and an image processing method for the 
image sensing apparatus. 



Furthermore, Another object of the present 
invention is to provide an image sensing apparatus 
which can reduce pseudo colors in. isolated pixels with 
relatively a simple construction, and an image 
5 processing method for the image sensing apparatus. 

In order to attain the above -described objects, 
the image sensing apparatus according to the present 
invention has the following configuration. 

More specifically, the present invention provides 

10 an image sensing apparatus comprising: an image sensing 
device; image forming means for forming an image on 
said image sensing device; A/D conversion means for 
converting an image signal outputted by said image 
sensing device into a digital signal; color 

15 interpolation means for performing color interpolation 
on the digital signal converted by said A/D conversion 
means and generating image data on a plurality of color 
planes; color space conversion means for converting a 
color space of the plurality of color planes to a color 

20 space of another colorimetric system; and isolated 
point removing means for reducing a pseudo color, 
generated by said color interpolation means , by 
controlling a color difference signal converted by said 
color space conversion means . 

25 Furthermore, the present invention provides an 

image sensing apparatus comprising: an image sensing 



device; image forming means for forming an image on 
said image sensing device; A/D conversion means for 
converting an image signal outputted by said image 
sensing device into a digital signal; color 
interpolation means for performing color interpolation 
on the digital signal converted by said A/D conversion 
means and generating image data on a plurality of color 
planes; pseudo color removing means for reducing a 
pseudo color component included in image data, on which 
color interpolation is performed by said color 
interpolation means; color space conversion means for 
converting a color space of the plurality of color 
planes , where a pseudo color is reduced by said pseudo 
color removing means, to a color space of another 
colorimetric system; and compression means for 
compressing image data where color space is converted 
by said color space conversion means. 

Herein, the isolated point removing means 
includes an isolated point removing filter which 
replaces a value of a pixel of interest with a 
substantial median pixel value of peripheral pixels of 
the pixel of interest. Also, the isolated point 
removing filter includes a median value filter or 
median filter. 

Moreover, the color interpolation means generates 
image data in R, G and B planes. 



Further, the color space conversion means may- 
convert RGB color space to YUV color space. 

Still further, the color space conversion means 
may convert RGB color space to Y, R-Y, B-Y color space. 

Still further, the color space conversion means 
may convert RGB color space to G, R-G, B-G color space. 

Moreover, the image forming means includes an 
infrared ray filter, or an infrared ray filter and 
optical low pass filter. 

Furthermore, the image processing method for the 
image sensing apparatus according to the present 
invention has the following steps . 

More specifically, the present invention provides 
an image processing method for an image sensing 
apparatus which includes an image sensing device and 
generates an image signal corresponding to an image 
formed on the image sensing device, comprising: an A/D 
conversion step of converting an image signal outputted 
by the image sensing device into a digital signal;- a 
color interpolation step of performing color 
interpolation on the digital signal converted in said 
A/D conversion step and generating image data on a 
plurality of color planes; a separation step of 
separating the image data in the plurality of color 
planes into luminance data and color difference data; 
an extraction step of extracting a high frequency 



component from the luminance data separated in said 
separation step; and a pseudo color removing step of 
reducing a pseudo color generated in said color 
interpolation step, in accordance with the high 
frequency component of the luminance data extracted in 
said extraction step and hue data obtained from the 
color difference data. 

Herein, the pseudo color removing step comprises: 
a determination step of determining whether or not the 
high frequency component of the luminance data and the 

hue data fall within a color range of the pseudo color; 
and a step of reducing a value of the color difference 

data, determined to be within the color range in said 

determination step. 

Moreover, in the color space conversion step, it 

is preferable that the color space be converted to YUV, 

or Y, R-Y , B-Y, or G, R-G, B-G color space. 

Moreover, the image processing method may further 

comprise a step of removing a high frequency component 

from a color signal, from which the pseudo color is 

removed in said pseudo color removing step. 

Herein, the color range of the pseudo color 

includes a color area from red to yellow, and a color 

area from blue to cyan. 

Other features and advantages of the present 

invention will be apparent from the following 



description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 
the same or similar parts throughout the figures 
thereof . 

BRIEF DESCRIPTION OF THE DRAWINGS 
The accompanying drawings, which are incorporated 
in and constitute a part of the specification, 
illustrate embodiments of the invention, and together 
with the description, serve to explain the principles 
of the invention. 

Fig. 1 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the first embodiment of the present 
invention; 

Figs . 2A and 2B are conceptual views explaining 
pseudo color removal according to embodiments of the 
present invention; 

Fig. 3 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the second embodiment of the 
present invention; 

Fig. 4 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the third embodiment of the present 
invention; 



Fig. 5 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the fourth embodiment of the 
present invention; 

Fig. 6 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the fifth embodiment of the present 
invention; 

Fig. 7 is a block diagram showing a configuration 
of a pseudo color removing processor according to the 
fifth embodiment; 

Fig. 8 is a block diagram showing a configuration 
after the gamma converter shown in Fig. 6, for a 
digital camera according to the sixth embodiment of the 
present invention; 

Fig. 9 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the seventh embodiment of the 
present invention; 

Fig. 10 is a conceptual view for explaining color 
interpolation according to embodiments of the present 
invention; 

Fig. 11 is an explanatory diagram showing a 
construction of a high frequency filter according to 
embodiments of the present invention; 

Fig. 12 is a graph explaining processing of a 



pseudo color suppression unit according to embodiments 
of the present invention; 

Fig. 13 shows a hue range of pseudo colors in 
pseudo color suppression processing according to 
embodiments of the present invention; 

Fig. 14 is a flowchart explaining pseudo color 
removing processing according to the seventh and eighth 
embodiments of the present invention; 

Fig. 15 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the eighth embodiment of the 
present invention; 

Fig. 16 is a block diagram showing a construction 
of an image processing unit of a digital camera 
according to the ninth embodiment of the present 
invention; 

Fig. 17 shows a hue range of pseudo colors in 
pseudo color suppression processing according to the 
ninth embodiment of the present invention; 

Fig. 18 is a block diagram showing a construction 
of an image processing unit of a digital camera 
according to the tenth embodiment of the present 
invention; 

Fig. 19 is a conceptual view explaining a general 
pseudo color generation process; 

Fig. 20 is a conceptual view explaining a general 



pseudo color generation process; 

Fig. 21 is a conceptual view explaining a general 
pseudo color generation process; and 

Fig. 22 is a conceptual view explaining a general 
pseudo color generation process. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Preferred embodiments of the present invention 

will be described in detail in accordance with the 

accompanying drawings . 

[First Embodiment] 

Fig. 1 is a block diagram showing, mainly, a 

construction of an image processing unit of a digital 

camera according to a first embodiment of the present 

invention. 

Light 1, incident upon the digital camera 
according to the first embodiment, passes through lens 
2, then the amount of the light is adjusted by a 
diaphragm 3, and an image sensing device 5 (hereinafter 
referred to as a CCD), e.g., CCD or CMOS, is exposed 
while a shutter (not shown) is open. Before the light 
1 is incident upon the CCD 5, an optical low pass 
filter 20 limits a spatial frequency of the light 1 to 
reduce moire in a way that an optical area of a long 
wavelength is cut off by an infrared ray (IR) filter 4 
so that the CCD 5 does not detect light in the infrared 



region. By the light incident upon the CCD 5, the 
amount of electric charge corresponding to the 
intensity of light is accumulated in the CCD 5. The 
amount of electric charge is amplified by a 
5 predetermined gain by a CDS-AGC 6, and converted to 
digital data by an A/D converter 7 . Image data 
converted to digital data in the foregoing manner is 
transferred to a white balance circuit 8 where R, G and 
B gains are adjusted. Then, by a color interpolator 9, 

10 the image data is generated in, for instance, three 

color (R, G and B) planes. The image data expressed in 
the R, G and B planes are then transferred to a masking 
processor 10 where adjustment is made for the hue of 
the R , G and B colors. Then, a gamma converter 11 

15 performs necessary processing for displaying an image 
on a display or the like. 

Next, compression according to JPEG or the like 
is performed on the image data since the data in the R, 
G and B color planes has a large amount of data. 

20 Herein, first, an RGB/YUV converter 12 converts 

the image data from R, G and B signals to Y color 
difference signals. For instance, R , G and B data are 
respectively converted to Y, U and V as follows: 

25 Y= 0.29900 X R + 0.58700 X G + 0.11400 X B (1) 
U= -0.16874 X R - 0.33126 X G + 0.50000 X B (2) 
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V= 0.50000 X R - 0.41869 X G - 0.08131 X B (3) 



Next, with respect to U and V, each representing 
a color difference signal, a pseudo color generated by 
color interpolation is reduced by median filters 13a 
and 13b. Low pass filters (LPF) 14a and 14b remove 
high frequency components to limit the band. Then, a 
thinning circuit 15 performs thinning processing which 
complies with a predetermined compression method, e.g., 
from Y:U:V = 4:4:4 to Y:U:V = 4:2:2 or Y:U:V = 4:1:1. 
Then, a compression circuit 16 adopting JPEG or the 
like performs compression. 

Figs. 2A and 2B explain the principle of 
processing performed by the median filters 13a and 13b 
according to the first (and subsequent) embodiment. 
Herein, Fig. 2A shows 3X3 pixels peripheral to a 
pixel of interest, and Fig. 2B shows a graph of pixel 
values arranged in the ascending order. 

Herein, for instance, 3X3 pixels peripheral to 
a pixel of interest a*22 are extracted, and the pixel 
values (color difference values) are arranged in the 
ascending order. Then, the value "20" of the pixel of 
interest is replaced with the value "10" of a*33, which 
is the substantial median value of the nine pixels. 
Such processing is performed by the median filters 13a 
and 13b, serving as isolated point removing filters. 



By this, isolated pseudo colors can be reduced without 
largely decreasing resolution. Note that since the 
configuration of the median filter is well known (e.g., 
disclosed in Japanese Patent Application Laid-Open No. 
5-233804 or No. 5-12437), detailed description thereof 
will be omitted. 

As has been described above, according to the 
first embodiment, a color space of an inputted image 
signal is converted from RGB to YUV color space, and an 
isolated pixel is removed from color difference signals 
U and V of the YUV signal by the median filter or the 
like. By virtue of this, pseudo colors generated by 
color interpolation can be reduced. 

[Second Embodiment] 

In the above-described first embodiment, color 
conversion from RGB to YUV color space is performed and 
pseudo color reduction processing is performed in the 
YUV color space before image compression is performed 
according to JPEG or the like. However, pseudo color 
reduction processing is not necessarily performed in 
YUV color space, but may be performed in another color 
space . 

According to the second embodiment of the present 
invention, pseudo color removal is performed by a 
median filter, after a color space of input image data 



is converted from RGB color space to Y, R-Y, B-Y color 
space. 

Fig. 3 is a block diagram showing a construction 
of an image processing unit of a digital camera 
according to the second embodiment. For the components 
that are common to the construction shown in Fig. 1, 
the same reference numerals are assigned and 
description thereof will be omitted. The second 
embodiment largely differs from the foregoing first 
embodiment in that the second embodiment does not 
necessitate JPEG compression and that the YUV 
conversion can be eliminated since the pseudo -color- 
removed image data is stored in a memory 19. Therefore, 
the construction of the image processing unit can be 
made simple, which contributes to the effect of the 
second embodiment. This is also applicable to a case 
of performing compression according to JPEG or the like. 

According to the second embodiment, in order to 
achieve reduction in the amount of calculation compared 
to the case of converting data from RGB to YUV color 
space, image data is converted from RGB color space to 
Y, R-Y, B-Y color space by, for instance, using a Y, R- 
Y, B-Y converter 17a. 

Herein, for instance, color space conversion is 
executed in the following manner: 



Y = 0.29900 X R + 0.58700 X G + 0.11400 X B (4) 
R-Y = R-Y (5) 
B-Y = B-Y (6) 



Then, the median filters 17b and 17c respectively 
executes median filtering of the R-Y signal and B-Y 
signal. Herein, the equation can be further simplified 
as follows to obtain luminance signal Y, color 
difference signals R-Y and B-Y: 



Y = R + 2XG + B = Ye (7) 
R-Y = R-Ye ( 8) 
B-Y = B-Ye (9) 



In this case, R-Ye and B-Ye are calculated with a 
luminance signal Ye which is a simplified (approximate) 
form of the luminance signal Y. By executing median 
filtering respectively to R-Ye and B-Ye, pseudo colors 
can be removed. Although the resultant values are 
slightly different from values of Y, R-Y and B-Y, a 
similar effect is achieved and calculation can be 
performed easily. Next, an RGB converter 17d 
respectively converts the Y, R-Y and B-Y signals back 
to R, G and B signals. The image data represented by R, 
G and B signals is subjected to masking by a masking 
processor 10 and to a gamma conversion by a gamma 



converter 11, and then stored in the non-volatile 
memory 19 . 

[Third Embodiment] 

In the above -described second embodiment, the 
luminance signal Y is consciously calculated from R, G 
and B signals. However, in image processing, G signal 
of the R, G and B may substitute for the luminance 
signal Y. 

The third embodiment is characterized by 
employing G, R-G and B-G signals instead of Y, R-Y and 
B-Y signals employed in the second embodiment, and 
executing median filtering to R-G and B-G signals 
respectively . 

Fig. 4 is a block diagram showing a construction 
of an image processing unit of a digital camera 
according to the third embodiment of the present 
invention. For the components that are common to the 
construction shown in Fig. 3, the same reference • 
numerals are assigned and description thereof will be 
omitted. 

According to the third embodiment, the amount of 
calculation is reduced further when compared against 
the case of converting R, G and B signals to luminance 
signal Y and color difference signals R-Y and B-Y. The 
G, R-G, B-G converter 18a generates G, R-G and B-G 



signals from R, G and B signals using the following 
equations : 



Y = 



G 



(10) 



5 



R-Y = 



R-G 



(11) 



B-Y = 



B-G 



(12) 



The median filters 18b and 18c respectively 
execute filtering to the R-G and B-G signals, thereby 

10 removing pseudo colors generated by color interpolation. 
Then, the RGB converter 18d converts the G, R-G and B-G 
signals back to RGB signals, which are then subjected 
to the masking processor 10 and gamma converter 11, and 
then stored in the non-volatile memory 19. 

15 As has been described above, since the third 

embodiment employs G signal in place of luminance 
signal Y, pseudo color reduction can be realized with a 
less amount of calculation, although there is a 
possibility that luminance components of the RGB- 

20 signals may be influenced by the result of median 
filtering. 

[Fourth Embodiment] 

The above -described first to third embodiments 
25 describe the case of employing an optical low pass 

filter before the CCD 5. Note that the configuration 
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before the CCD 5 is not shown in Figs. 3 and 4. 

The fourth embodiment describes a case where no 
problem arises even though the optical system does not 
comprise such optical low pass filter. 
5 Fig. 5 is a block diagram showing a construction 

of an image processing unit of a digital camera 
according to the fourth embodiment of the present 
invention. For the components that are common to the 
construction shown in Fig. 1, the same reference 

10 numerals are assigned and description thereof will be 
omitted. The fourth embodiment is characterized in 
that the IR filter 4 for cutting infrared rays is 
provided before the CCD 5 , and that the optical low 
pass filter 20 employed in Fig. 1 is removed. The 

15 configuration after the CCD 5 is the same as that shown 
in block diagram of Fig. 1. 

However, when the optical low pass filter 20 is 
removed, pseudo colors are generated more than the case 
of including the optical low pass filter 20. In view 

20 of this, the number of elements in median filters 130a 
and 130b in the fourth embodiment is increased from the 
number of elements "9" of the median filters according 
to first to third embodiments. By this, the median 
filtering can be executed in a wider area, and pseudo 

25 colors can be reduced. 

Accordingly, since the fourth embodiment is 
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realized by simply mounting the IR filter 4 on the 
glass surface of the CCD 5, the apparatus main body can 
be made small and cost reduction can be achieved. In 
addition, image signals of high resolution can be 
5 obtained. 

For the isolated point removing filter, filtering 
called smoothing {Edge Preserving Smoothing), which 
preserves edges, may be employed besides the above- 
described median filter. More specifically, a window 
10 W(i, j) is set with a pixel f(x, y) as its center, and 
an output g(x, y) is calculated. Assuming that the 
window size is m X n , the following equation stands: 



15 For instance, assuming a matrix M in which data "1" is 
arranged in 3 X 3 matrix, the following equation 



For an alternative isolated point removing filter, 
another smoothing (Maximum Homogeneity Smoothing) which 
preserves edges may be employed. This smoothing 
enables selection of a most uniform area in the 




stands : 



W = M/9 



20 



- 22 - 



neighborhood of a pixel. When the weight coefficient 
Fi is defined as follows: 



weight coefficient Fi = {min (ai)} / ai 
5 where an average value of each block is ^i, 
distribution is ai, and m (arbitrary), 

the output g(x, y) is obtained in the following manner: 



Besides the above, filtering called hysteresis 
smoothing may be employed. More specifically, a 
hysteresis characteristic is produced for a data value, 
and noise is absorbed by the hysteresis characteristic. 
15 Any of the aforementioned filters may be used as long 
as interpolation or smoothing is performed by using 
outputs of peripheral pixels of an isolated point 
having a pixel value largely different from peripheral 
pixel values . 

20 

[Fifth Embodiment] 

Fig. 6 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the fifth embodiment of the present 




10 
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invention. For the components that are common to the 
foregoing embodiments, the same reference numerals are 
assigned. 

Light 1 , incident upon the digital camera 
5 according to the fifth embodiment, passes through the 
lens 2, then the amount of the light is adjusted by the 
diaphragm 3, and the image sensing device 5 
(hereinafter referred to as a CCD), e.g., CCD or CMOS, 
is exposed while a shutter (not shown) is open. Before 

10 the light 1 is incident upon the CCD 5 , a frequency 

region of a long wavelength is cut off by the IR filter 
4 so that the CCD 5 does not detect light in the 
infrared region. By the light incident upon the CCD 5, 
the amount of electric charge corresponding to the 

15 intensity of light is accumulated in the CCD 5. The 
amount of electric charge is amplified by a 
predetermined gain by the CDS-AGC 6 , and converted to 
digital data by the A/D converter 7 . Image data 
converted to digital data in the foregoing manner is 

20 transferred to the white balance circuit 8 where R, G 
and B gains are adjusted. Then, by the color 
interpolator 9, the image data is generated in, for 
instance, three color (R, G and B) planes. The image 
data expressed in the R, G and B planes are then 

25 transferred to the masking processor 10 where 

adjustment is made for the hue of the R, G and B colors. 



Then, the gamma converter 11 performs necessary 
processing for displaying an image on a display or the 
like. 

Next, a pseudo color removing processor 21 
reduces pseudo colors generated by color interpolation 
of the color interpolator 9. Further, compression 
processing according to JPEG or the like is performed 
on the image data since the data in the R, G and B 
color planes has a large amount of data. Herein, first, 
the RGB/YUV converter 12 converts the image data from R, 
G and B signals to Y color difference signal, and with 
respect to each of the color difference signals U and V, 
the LPF 14a and 14b respectively perform low pass 
filtering to limit the band. Then, the thinning 
circuit 15 performs thinning processing which complies 
with a predetermined compression method, e.g., from 
Y:U:V = 4:4:4 to Y:U:V = 4:2:2 or Y:U:V = 4:1:1. Then, 
a JPEG compression circuit 16 performs compression 
according to JPEG. 

Fig. 7 is a block diagram showing a configuration 
of the pseudo color removing processor 21 according to 
the fifth embodiment. 

Assume that image data is generated in R, G and B 
planes by the color interpolator 9. The RGB/XYZ 
converter 21a converts image data from RGB color space 
to XYZ color space. The conversion is executed by the 



following equations (13) to (15): 



X= 2.7689 X R + 1.7517 X G + 1.1302 X B (13) 
Y= 1.0000 X R + 4.5907 X G + 0.0601 X B (14) 
Z = 0.0000 X R + 0.0565 X G + 5.5943 X B (15) 

Then, XYZ/L*a*b* converter 21b converts the image 
data from XYZ color space to L*a*b* color space. The 
conversion is executed by the following equations (16) 
to (18): 

L*= 116 (Y/YJ 1/3 -16 (Y/Y 0 >0. 008856) (16) 
a*= 500 [(X/X 0 ) 1/3 - (Y-Y 0 ) 1/3 ] (17) 
b*= 200 [(Y/Y 0 ) 1/3 - (Z-Z 0 ) 1/3 ] (18) 

X 0 , Y 0 and Z 0 represent tristimulus values of the 
perfect diffuse surface. 

Herein, median filters 21c and 21d, each serving 
as an isolated point filter, execute median filtering 
(median value filtering) respectively to a* and b* of 
the L*a*b*. 

Since the principle of the processing performed 
by the median filters 21c and 21d is the same as the 
aforementioned description shown in Figs. 2A and 2B, 
description thereof will not be provided herein. 

Then, L*a*b*/XYZ converter 21e converts image 



data from L*a*b* color space to XYZ color space. 
Finally, XYZ /RGB converter 2 If converts the image data 
from XYZ color space to RGB color space. By this, 
median filtering can be executed only in a color space 
5 that gives small influence to the luminance 

(resolution). Therefore, the decrease in resolution of 
an image can be prevented. 

[ Sixth Embodiment ] 
10 Fig. 8 is a block diagram showing a configuration 

according to the sixth embodiment of the present 
invention . 

In the foregoing fifth embodiment, image data in 
RGB color space, which has been outputted by the pseudo 
15 color removing processor 21, is converted from RGB 

color space to YUV color space by the RGB/YUV converter 
12 to be subjected to JPEG compression. This YUV 
conversion is executed by the aforementioned equations 
(1) to (3). 

20 According to the sixth embodiment, instead of the 

pseudo color removing processor 21, the median filters 
(median value filters) 17b and 17c execute filtering to 
U and V signals outputted by the RGB/YUV converter 12. 
Then, to perform JPEG compression, the LPF 14a and 14b 

25 perform low pass filtering to color difference data to 
limit the band of the color difference signals. Then, 
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the thinning circuit 15 performs thinning into a 
predetermined format, e.g., from Y:U:V = 4:4:4 to Y:U:V 
= 4:2:2 or Y:U:V = 4:1:1, and compression is performed 
by the JPEG compression circuit 16. 
5 For the isolated point removing filter, filtering 

called smoothing (Edge Preserving Smoothing) for 
preserving edges, which has been described in the 
fourth embodiment, may be employed besides the above- 
described median filter. 
10 Furthermore, for the isolated point removing 

filter, smoothing (Maximum Homogeneity Smoothing) for 
preserving edges, which has been described in the 
fourth embodiment, may be employed. 

Besides the above, filtering called hysteresis 
15 smoothing may be employed. More specifically, a 

hysteresis characteristic is produced for a data value, 
and noise is absorbed by the hysteresis characteristic. 
Any of the aforementioned filters may be used as long 
as interpolation or smoothing is performed by using 
20 outputs of peripheral pixels of an isolated point 

having a pixel value largely different from peripheral 
pixel values . 

[Seventh Embodiment] 
25 A characteristic feature of the seventh 

embodiment is described before explaining a specific 
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example of the seventh embodiment . To eliminate the 
above-described pseudo colors, it is ideal to employ 
three -plate camera where CCDs are provided for each of 
the R, G and B color components. With such structure, 
the size of a camera increases . In the seventh 
embodiment, an attention is directed to the fact that 
pseudo colors generated from red (R) to yellow (Y) and 
from blue (B) to cyan (C) have high frequencies. Thus, 
the characteristic feature of the seventh embodiment is 
to suppress generation of pseudo colors by reducing the 
gain of a color difference signal when the luminance 
signal has a high frequency component and the hue falls 
within a predetermined range. 

Fig. 9 is a block diagram showing, mainly, a 
construction of an image processing unit of a digital 
camera according to the seventh embodiment of the 
present invention. 

Light 1, incident upon the camera, passes through 
the lens 2, then the amount of the light is adjusted by 
the diaphragm 3, and the image sensing device 5 
(hereinafter referred to as a CCD), e.g., CCD or CMOS, 
is exposed while a shutter (not shown) is open. Before 
the light 1 is incident upon the CCD 5, a frequency 
area (band) of a long wavelength is cut off by the IR 
filter 4 so that the CCD 5 does not detect light in the 
infrared region. The light incident upon the CCD 5 is 



accumulated in the CCD 5 as an electric charge, and 
outputted as an electric signal. The electric signal 
is amplified by a predetermined gain by the CDS-AGC 6, 
and converted to digital data by the A/D converter 7. 
5 Image data converted to digital data in the foregoing 
manner is transferred to the white balance circuit 8 
where R, G and B gains are adjusted. Then, in the 
color interpolator 9, the image data is generated in, 
for instance, three color (R, G and B) planes as shown 

10 in Fig 10. The image data expressed in the R, G and B 
planes are then transferred to the masking processor 10 
where adjustment is made for the hue of the R, G and B 
colors. Then, the gamma converter 11 performs 
necessary processing for displaying an image on a 

15 display or the like. Further, compression processing 

according to JPEG or the like is performed on the image 
data since the data in the R, G and B color planes has 
a large amount of data. 

First, RGB/Y converter 22 converts RGB color 

20 space to color space of Y color difference signal. The 
conversion is executed by, for instance, above- 
mentioned equations (1) to (3). 

To detect high frequency components and hue, the 
image data, expressed in the R, G and B planes by the 

25 color interpolator 9, is subjected to calculation of a 
luminance signal Y by the RGB/Y converter 22, using the 
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aforementioned equation (1). Next, to obtain a high 
frequency component of the obtained luminance signal Y, 
a spatial high pass filter (HPF) 23 executes spatial 
high pass filter computation as shown in Fig. 11. The 
5 luminance signal Y, obtained by the RGB/Y converter 22, 
is transferred to a hue detection circuit 24 for 
detecting a hue, where color difference signals R-Y and 
B-Y are calculated and a hue is detected based on the 
calculated results. The detected hue data is outputted 

10 to a pseudo color suppression circuit 13. Referring to 
Fig. 11, spatial high pass filter computation is 
executed by multiplying an input signal by a matrix 300, 
and subtracting the input signal from the 
multiplication result by a subtractor 301. 

15 The pseudo color suppression circuit 13 

suppresses pseudo colors by reducing gains of U and V, 
outputted by the RGB/Y converter 22, based on the high 
frequency component of the luminance signal Y obtained 
by the spatial high pass filter 23 and the hue data 

20 obtained by the hue detection circuit 24 . 

The pseudo color suppression processing is 
described with reference to Figs. 12 and 13. 

First, it is determined whether or not a color of 
the pixel of interest falls within a predetermined 

25 range (area indicated by hatching in Fig. 13) in Y, R-Y, 
B-Y color space. If the color is determined to be in 
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the range where it is considered as a pseudo color, 
gains of the color difference signals U and V, having a 
predetermine value ofl or larger as shown in Fig. 12, 
are reduced in accordance with a high frequency 
5 component value of the luminance signal outputted by 
the spatial high pass filter 23. By this, pseudo 
colors can be suppressed. 

Pseudo color suppression processing performed in 
the above -described configuration is explained. A high 

10 frequency component, such as that having a vertical 

stripe pattern or a checker flag pattern described with 
reference to Figs. 19 to 22, is extracted by the 
spatial HPF 23. The aforementioned pseudo color 
generation is prevented by reducing gains of color 

15 difference signals U and V in the extracted high 

frequency area, which may cause pseudo colors described 
in Figs. 19 to 22 (for instance, predetermined areas of 
R and Y components in Fig. 19, predetermined areas of C 
and B components in Fig. 20, or predetermined areas of 

20 R and B components in Figs. 21 and 22, all of which 
correspond to the hatching portion in Fig. 13). 

Next, the low pass filter (LPF) 14 execute low 
pass filtering in the horizontal or vertical direction. 
Then, the thinning circuit 15 performs thinning 

25 processing of the color difference signals, in 

accordance with a predetermined JPEG format, e.g., from 



Y:U:V = 4:4:4 to Y:U:V = 4:2:2 or Y:U:V = 4:1:1. Then, 
the JPEG compression circuit 16 performs JPEG 
compression. By this, a compressed image having less 
pseudo colors can be generated. 
5 Note herein that instead of calculating the 

luminance signal Y by the aforementioned equation (1), 
the calculation may be executed with a simplified 
luminance signal Ye. For instance, aforementioned 
equation (7), Ye = R + 2XG + B, may be used. 

10 Alternatively, a green (G) signal component may 

be used as a luminance signal without calculating the 
luminance signal. 

Fig. 14 is a flowchart explaining pseudo color 
removing processing according to the seventh embodiment 

15 of the present invention. 

Referring to Fig. 14, in step SI, R, G and B 
signals of an image, upon which color interpolation 
processing has been performed, are inputted and a 
luminance signal- Y is generated from the R, G and B 

20 signals by the RGB/Y converter 22. In step S2 , high 
frequency components of the luminance signal Y are 
extracted by the spatial high pass filter (HPF) 23. In 
step S3, differences are respectively calculated 
between each of R, B signals and the luminance signal Y 

25 by the hue detection circuit 24, and color difference 
signals R-Y and B-Y are generated. In step S4, a hue 
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signal is generated based on the color difference 
signals, and it is determined whether or not the hue 
signal falls within a color range that is considered as 
pseudo colors . If it is determined as a pseudo color 
5 in step S5, the control proceeds to step S6 where gains 
of the color difference signals in the pseudo color 
portion are reduced in accordance with the amount of 
high frequency component of the pixel. By this, for 
instance, in the color space corresponding to the 

10 hatching area in Fig. 13, pseudo color components 
generated by color interpolation can be suppressed. 
Then the process proceeds to step S7 , isolated pixels 
of the image are removed. 

As described above, the seventh embodiment 

15 achieves an effect of preventing pseudo colors 

generation from red to yellow and from blue to cyan. 

[Eighth Embodiment] 

A characteristic feature of the eighth embodiment 

20 is described before explaining a specific example of 
the eighth embodiment. To eliminate the above- 
described pseudo colors, it is ideal to employ three- 
plate camera where CCDs are provided for each of the R, 
G and B color components. With such structure, the 

25 size of a camera increases. In the eighth embodiment, 
an attention is directed to the fact that pseudo colors 



generated from red (R) to yellow (Y) and from blue (B) 
to cyan (C) have high frequencies. Thus, the 
characteristic feature of the eighth embodiment is to 
suppress generation of pseudo colors by removing an 
5 isolated point of a luminance signal, having a high 
frequency component and, if the hue falls within a 
predetermined range, reducing the gain of the color 
difference signal. 

Fig. 15 is a block diagram showing, mainly, a 

10 construction of an image processing unit of a digital 
camera according to the eighth embodiment of the 
present invention. 

The pseudo color suppression circuit 13 
suppresses pseudo colors by reducing gains of U and V, 

15 outputted by the RGB/YUV converter 22, based on a high 
frequency component of the luminance signal Y obtained 
by the spatial high pass filter 23 and hue data 
obtained by the hue detection circuit 24. The pseudo 
color suppression processing is performed in the same 

20 manner as that of the above -described seventh 
embodiment . 

Among the above- described pseudo colors, patterns 
of pseudo colors from red (R) to yellow (Y) and from 
blue (B) to cyan (C) can be determined as pseudo colors 
25 by detecting high frequency components of the luminance 
signal because the degree of luminance of pseudo colors 
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are different from others. However, pseudo colors 
generated around a character are often isolated, and 
the degree of luminance of ht pseudo colors are not 
always different from the peripheral pixel luminance. 
5 In view of the above, according to the eighth 

embodiment, the median filters 24a and 24b remove 
isolated points with respect to the color difference 
signals U and V and further perform pseudo color 
removal. Figs. 2A and 2B explain this processing. 

10 Herein, elements having 3X3 pixel area including a 
pixel of interest are arranged in the ascending order, 
and the value of the pixel of interest is replaced with 
a median value of the arranged pixels . By this , a 
pixel, having a color of extremely different hue from 

15 the hues of peripheral pixels, can be eliminated. 
Particularly, since the low pass filtering is not 
executed in the eighth embodiment, resolution does not 
decrease largely, thus does not influence peripheral 
pixels . 

20 Pseudo color suppression processing performed in 

the above -described configuration is explained. A high 
frequency component , such as that having a vertical 
stripe pattern or a checker flag pattern described with 
reference to Figs. 19 to 22, is extracted by the 

25 spatial HPF 23. The aforementioned pseudo color 

generation is prevented by reducing gains of color 
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difference signals U and V in the extracted high 
frequency area, which may cause the pseudo colors 
described in Figs. 19 to 22 (for instance, 
predetermined areas of R and Y components in Fig. 19, 
5 predetermined areas of C and B components in Fig. 20, 
or predetermined areas of R and B components in Figs. 
21 and 22, all of which correspond to the hatching 
portion in Fig. 13). After pseudo colors are 
suppressed in the foregoing manner, the median filters 

10 24a and 24b execute above- described filtering, thereby 
removing isolated pixels . 

Next, the low pass filter (LPF) 14a and 14b 
execute low pass filtering in the horizontal or 
vertical direction. Then, the thinning circuit 15 

15 performs thinning processing of the color difference 

signals, in accordance with a predetermined JPEG format, 
e.g., from Y:U:V = 4:4:4 to Y:U:V = 4:2:2 or Y:U:V = 
4:1:1. Then, the JPEG compression circuit 16 performs 
JPEG compression. By this, a compressed image having 

20 less pseudo colors can be generated. 

Note that, to calculate the luminance signal Y, 
the aforementioned equation (7) may be used. 

Alternatively, a green (G) signal component may 
be used as a luminance signal without calculating the 

25 luminance signal. 

Since the pseudo color removal processing 



according to the eighth embodiment is performed in the 
same manner as that explained in the flowchart in Fig. 
14, detailed description will be omitted herein. 



5 [Ninth Embodiment] 

In the foregoing seventh and eighth embodiments, 
means for detecting pseudo colors is provided after the 
color interpolator 9 and pseudo color detection is 
performed using signals in the R, G and B planes. The 

10 reason is that, since processing such as masking 

processing, y conversion and so forth that may cause 
changes in hue are performed after the color 
interpolator 9 , the hue range of the detected pseudo 
colors may change. Because of this reason, the 

15 luminance signal Y is calculated to obtain color 

difference signals R-Y and B-Y. However, the pseudo 
color detection means does not have to be provided in 
this position. For instance, in order to perform JPEG 
compression, RGB color space must be converted to a 

20 color space of luminance or color difference . 

Therefore, pseudo colors can be detected from these 
signals. The ninth embodiment relates to such case. 
Note that, as mentioned above, there is a possibility 
that the hue range of pseudo colors changes depending 

25 on images . 

Fig. 16 is a block diagram showing a construction 



of an image processing unit of a digital camera 
according to the ninth embodiment of the present 
invention. For the components that are common to the 
construction shown in Fig. 9, the same reference 
5 numerals are assigned. 

Light 1, incident upon the camera, passes through 
the lens 2, then the amount of the light is adjusted by 
the diaphragm 3, and the CCD 5 is exposed while a 
shutter (not shown) is open. Before the light 1 is 

10 incident upon the CCD 5, a frequency area of a long 
wavelength is cut off by the IR filter 4 so that the 
CCD 5 does not detect light in the infrared region. 
The light incident upon the CCD 5 is accumulated in the 
CCD 5 as an electric charge, and outputted as an 

15 electric signal. The electric signal is amplified by a 
predetermined gain by the CDS-AGC 6 , and converted to 
digital data by the A/D converter 7 . Image data 
converted to digital data in the foregoing manner is 
transferred to the white balance circuit 8 where R, G 

20 and B gains are adjusted. Then, in the color 

interpolator 9, the image data is generated in, for 
instance, three color (R, G and B) planes as shown in 
Fig. 2. The image data expressed in the R, G and B 
planes are then transferred to the masking processor 10 

25 where adjustment is made for the hue of the R, G and B 
colors. Then, the gamma converter 11 performs 
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necessary processing for displaying an image on a 
display or the like. Then, RGB/YUV converter 12 
converts the image data from RGB color space to color 
space of Y color difference signal. 
5 Among the converted signals, luminance signal Y 

is transmitted to the spatial high pass filter (HPF) 25 
for detecting high frequency components of the signal 
by the filtering shown in Fig. 11. Then, a hue 
detection circuit 26 determines whether or not a pixel 

10 of interest falls within the hue range of pseudo colors. 
Herein, instead of the above -described color space R-Y 
and B-Y shown in Fig. 13, U and V outputted by the 
RGB/YUV converter 12 are used as shown in Fig. 17. 

As similar to the seventh and eighth embodiments, 

15 if it is determined that a color of the pixel of 

interest falls within the hue range of pseudo colors, 
the pseudo color suppression circuit 13 reduces gains 
of the color difference signals U and V, having a value 
ofl or larger as shown in Fig. 12, in accordance with 

20 an output value of the spatial HPF 25. 

In this case, for instance, it may be necessary 
to change, for instance, the hue range depending on the 
white balance. For instance, when the gain of red is 
increased, the hue range is shifted towards red, or a 

25 hue angle is widened. 

Next, the LPF 14a and 14b execute low pass 
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filtering in the horizontal or vertical direction. 
Then, the thinning circuit 15 performs thinning 
processing of the color difference signals, in 
accordance with a predetermined JPEG format, e.g., from 
5 Y:U:V = 4:4:4 to Y:U:V = 4:2:2 or Y:U:V = 4:1:1. Then, 
the JPEG compression circuit 16 performs JPEG 
compression . 

By this , a compressed image having less pseudo 
colors can be generated. 

10 

[Tenth Embodiment] 

In the foregoing seventh and eighth embodiments, 
means for detecting pseudo colors is provided after the 
color interpolator 9 and pseudo color detection is 

15 performed using signals in the R, G and B planes. The 
reason is that, since processing such as masking 
processing, y conversion and so forth that may cause 
changes in hue are performed after the color 
interpolator 9 , the hue range of the detected pseudo 

20 colors may change. Because of this reason, the 
luminance signal Y is calculated to obtain color 
difference signals R-Y and B-Y. However, the pseudo 
color detection means does not have to be provided in 
this position. For instance, in order to perform JPEG 

25 compression, RGB color space must be converted to a 
color space of luminance and color difference. 
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Therefore, pseudo colors can be detected from these 
signals . With reference to the foregoing eighth 
embodiment (Fig. 15), in the median filters 24a and 24b 
where pseudo color suppression is performed, delay is 
5 generated between the luminance signal Y and color 
difference signals U and V. Because of this, the 
luminance signal must also be delayed. The tenth 
embodiment makes use of this delay. 

Fig. 18 is a block diagram showing a construction 

10 of an image processing unit of a digital camera 
according to the tenth embodiment of the present 
invention. For the components that are common to the 
construction shown in Fig. 15, the same reference 
numerals are assigned. 

15 Light 1, incident upon the camera, passes through 

the lens 2, then the amount of the light is adjusted by 
the diaphragm 3, and the CCD 5 is exposed while a 
shutter {not shown) is open. Before the light 1 is 
incident upon the CCD 5, a frequency area of a long 

20 wavelength is cut off by the IR filter 4 so that the 
CCD 5 does not detect light in the infrared region. 
The light incident upon the CCD 5 is accumulated in the 
CCD 5 as an electric charge, and outputted as an 
electric signal. The electric signal is amplified by a 

25 predetermined gain by the CDS-AGC 6 , and converted to 
digital data by the A/D converter 7 . Image data 



converted to digital data in the foregoing manner is 
transferred to the white balance circuit 8 where R, G 
and B gains are adjusted. Then, in the color 
interpolator 9, the image data is generated in, for 
5 instance, three color (R, G and B) planes as shown in 
Fig. 2. The image data expressed in the R, G and B 
planes are then transferred to the masking processor 10 
where adjustment is made for the hue of the R, G and B 
colors. Then, the gamma converter 11 performs 

10 necessary processing for displaying an image on a 
display or the like. Then, RGB/YUV converter 12 
converts the image data from RGB color space to color 
space of Y color difference signal. 

Among the converted signals, luminance signal Y 

15 is transmitted to the spatial high pass filter (HPF) 25 
for detecting high frequency components of the 
luminance signal by the filtering shown in Fig. 11. 
Meanwhile, color difference signals U and V are 
transmitted to the median filters 24a and 24b for 

20 executing the above -described median filtering shown in 
Figs. 2A and 2B. By virtue of this, while high 
frequency components of the luminance signal Y are 
detected, median filtering is executed to the color 
difference signals. Therefore, it is possible to 

25 reduce wasteful use of a memory caused by delay of one 
of the signals. 
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Next, the hue detection circuit 26 determines 
whether or not a pixel of interest falls within the hue 
range of pseudo colors. Herein, instead of the above- 
described color space R-Y and B-Y shown in Fig. 13, U 
5 and V outputted by the RGB/YUV converter 12 are used as 
shown in Fig. 17. 

As similar to the eighth embodiment, if it is 
determined that a color of the pixel of interest falls 
within the hue range of pseudo colors, the pseudo color 
10 suppression circuit 13 reduces gains of the color 
difference signals U and V, having a value ofl or 
larger as shown in Fig. 12, in accordance with an 
output value of the spatial HPF 25. 

In this case, for instance, it may be necessary 
15 to change, for instance, the hue range depending on the 
white balance. For instance, when the gain of red is 
increased, the hue range is shifted to the red, or a 
hue angle is widened. 

Next, the LPF 14a and 14b execute low pass 
20 filtering in the horizontal or vertical direction. 
Then, the thinning circuit 15 performs thinning 
processing of the color difference signals, in 
accordance with a predetermined JPEG format, e.g., from 
Y:U:V = 4:4:4 to Y:U:V = 4:2:2 or Y:U:V = 4:1:1. Then, 
25 the JPEG compression circuit 16 performs JPEG 
compression . 



- 44 - 



By this, a compressed image having less pseudo 
colors can be generated. 

The present invention can be applied to a system 
constituted by a plurality of devices (e.g., host 
5 computer, interface, reader, printer) or to an 

apparatus comprising a single device {e.g. , copying 
machine, facsimile machine) . 

Further, the object of the present invention can 
also be achieved by providing a storage medium storing 
10 program codes for performing the aforesaid processes to 
a computer system or apparatus (e.g., a personal 
computer), reading the program codes, by a computer 
{CPU or MPU) of the system or apparatus, from the 
storage medium, then executing the program. 
15 In this case, the program codes read from the 

storage medium realize the functions according to the 
embodiments, and the storage medium storing the program 
codes constitutes the invention. 

Further, the storage medium, such as a floppy 
20 disk, a hard disk, an optical disk, a magneto- optical 
disk, CD-ROM, CD-R, a magnetic tape, a non-volatile 
type memory card, and ROM can be used for providing the 
program codes . 

Furthermore, besides aforesaid functions 
25 according to the above embodiments are realized by 
executing the program codes which are read by a 



computer, the present invention includes a case where 
an OS (operating system) or the like working on the 
computer performs a part or the entire processes in 
accordance with designations of the program codes and 
5 realizes functions according to the above embodiments . 

Furthermore, the present invention also includes 
a case where, after the program codes read from the 
storage medium are written in a function expansion card 
which is inserted into the computer or in a memory 

10 provided in a function expansion unit which is 

connected to the computer, CPU or the like contained in 
the function expansion card or unit performs a part or 
the entire process in accordance with designations of 
the program codes and realizes functions of the above 

15 embodiments . 

As has been set forth above, according to the 
above -described embodiments, RGB color space is 
converted to YUV or Y, R-Y, B-Y or G, R-G, B-G color 
space, and- isolated point removing filtering (e.g., 

20 median filter or the like) is executed respectively to 
color difference signals in UV, or R-Y, B-Y or R-G, B-G 
color space, thereby enabling reduction of pseudo 
colors generated by color interpolation. 

Furthermore, according to the above -describe 

25 embodiments, even if an optical low pass filter is not 
provided before the image sensing device, such as CCD 
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or the like, pseudo color components can be reduced by 
converting RGB color space to L*a*b* or YUV color space, 
then performing filtering to color difference signals 
such as a* and b* signals or U and V signals with the 
5 isolated point removing filter, and then performing 

compression according to JPEG or the like. Accordingly, 
an image, having less block distortion and reduced 
pseudo color components, can be obtained. 

Furthermore, according to the above-described 

10 embodiments, pseudo colors generated by color 

interpolation can be suppressed by detecting high 
frequency components of a luminance signal and pseudo 
colors generated from red to yellow and from blue to 
cyan in the hue, and then reducing gains of color 

15 difference signals U and V. 

Still further, according to the above- described 
embodiments, pseudo colors generated by color 
interpolation can be suppressed by detecting high 
frequency components of a luminance signal and pseudo 

20 colors generated from red to yellow and from blue to 
cyan in the hue, then reducing gains of color 
difference signals U and V, and further eliminating 
isolated pixels. 

Still further, according to the above-described 

25 embodiments, pseudo colors generated by color 

interpolation can be suppressed by executing median 
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filtering to color difference signals in the color 
space of luminance and color difference signals, then 
detecting high frequency components of a luminance 
signal and pseudo colors generated from red to yellow 
5 and from blue to cyan in color difference signals, and 
reducing gains of color difference signals U and V. 

Still further, according to the above-described 
embodiments, by executing median filtering to color 
difference signals while detecting high frequency 

10 components of a luminance signal, it is possible to 
eliminate a processing circuit necessary to match 
delayed timing of the luminance signal and color 
difference signals . 

The present invention is not limited to the above 

15 embodiments and various changes and modifications can 
be made within the spirit and scope of the present 
invention. Therefore, to apprise the public of the 
scope of the present invention, the following claims 
are made. 
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WHAT IS CLAIMED IS: 

1. An image sensing apparatus comprising: 
an image sensing device; 

5 focusing means for focusing into an image on said 

image sensing device; 

A/D conversion means for converting an image 
signal outputted by said image sensing device into a 
digital signal; 
10 color interpolation means for performing color 

interpolation on the digital signal converted by said 
A/D conversion means and generating image data on a 
plurality of color planes; 

color space conversion means for converting a 
15 color space of the plurality of color planes to a color 
space of another colorimetric system; and 

pseudo color removing means for reducing a color 
component, generated by said color interpolation means, 
by controlling a color difference signal converted by 
20 said color space conversion means. 

2. The image sensing apparatus according to 
claim 1 , wherein said pseudo color removing means 
includes an isolated point removing filter which 

25 replaces a value of a pixel of interest with a 

substantial median pixel value of peripheral pixels of 
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the pixel of interest. 

3 . The image sensing apparatus according to 
claim 2, wherein said isolated point removing filter 
includes a median value filter or median filter. 

4. The image sensing apparatus according to 
claim 1, wherein said color interpolation means 
generates image data in R, G and B planes. 

5. The image sensing apparatus according to 
claim 1 , wherein said color space conversion means 
converts RGB color space to YUV color space. 

6 . The image sensing apparatus according to 
claim 1, wherein said color space conversion means 
converts RGB color space to Y, R-Y, B-Y color space. 

7 . The image sensing apparatus according to 
claim 1 , wherein said color space conversion means 
converts RGB color space to G, R-G, B-G color space. 

8. The image sensing apparatus according to 
claim 1, wherein said focusing means includes an 
infrared ray filter, or an infrared ray filter and 
optical low pass filter. 
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9. An image sensing apparatus comprising: 
an image sensing device ; 

focusing means for focusing into an image on said 
5 image sensing device; 

A/D conversion means for converting an image 
signal outputted by said image sensing device into a 
digital signal; 

color interpolation means for performing color 
10 interpolation on the digital signal converted by said 
A/D conversion means and generating image data on a 
plurality of color planes; 

pseudo color removing means for reducing a color 
component included in image data, on which color 
15 interpolation is performed by said color interpolation 
means ; 

color space conversion means for converting a 
color space of the plurality of color planes , where the 
color component is reduced by said pseudo color 
20 removing means, to a color space of another 
colorimetric system; and 

compression means for compressing image data 
where color space is converted by said color space 
conversion means. 



10. The image sensing apparatus according to 



claim 9 , wherein said pseudo color removing means 
comprises : 

first color space conversion means for converting 
a color space of the plurality of color planes to a 
5 color space of another colorimetric system; 

isolated point removing means for reducing an 
isolated pseudo color component by controlling signals 
except a luminance component signal of the colorimetric 
system converted by said first color space conversion 
10 means ; and 

second color space conversion means for 
converting the color space, converted by said first 
color space conversion means , to an original color 
space . 

15 

11. The image sensing apparatus according to 
claim 10, wherein said isolated point removing means 
includes an isolated point removing filter which 
replaces a value of a pixel of interest with a 
20 substantial median pixel value of peripheral pixels of 
the pixel of interest. 
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12. The image sensing apparatus according to 
claim 11, wherein said isolated point removing filter 
includes a median value filter or median filter. 



13. The image sensing apparatus according to 
claim 10, wherein said color interpolation means 
generates image data in R, G and B planes. 



5 14. The image sensing apparatus according to 

claim 11, wherein said first color space conversion 
means converts RGB color space to L*a*b* color space, 
and said isolated point removing means causes the 
isolated point removing filter to filter a frequency 
10 range of a* and b* signals. 

15. The image sensing apparatus according to 
claim 10, wherein said color space conversion means 
converts RGB color space to YUV color space. 

15 

16. An image sensing apparatus comprising: 
an image sensing device; 

focusing means for focusing into an image on said 
image sensing device; 
20 A/D conversion means for converting an image 

signal outputted by said image sensing device into a 
digital signal; 

color interpolation means for performing color 
interpolation on the digital signal converted by said 
25 A/D conversion means and generating image data on a 
plurality of color planes ; 
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separation means for separating the image data in 
the plurality of color planes into luminance data and 
color difference data; 

extraction means for extracting a high frequency 
5 component from the luminance data separated by said 
separation means; and 

pseudo color removing means for reducing a color 
component generated by said color interpolation means , 
in accordance with the high frequency component of the 
10 luminance data extracted by said extraction means and 
hue data obtained from the color difference data. 



17. The image sensing apparatus according to 
claim 16, wherein said pseudo color removing means 

15 comprises : 

determination means for determining whether or 
not the high frequency component of the luminance data 
and the hue data fall within a color range of the 
pseudo color; and 

20 means for reducing a value of the color 

difference data, determined to be within the color 
range by said determination means. 



18. An image sensing apparatus comprising: 
25 an image sensing device ; 

focusing means for focusing into an image on said 
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image sensing device ; 

A/D conversion means for converting an image 
signal outputted by said image sensing device into a 
digital signal; 
5 color interpolation means for performing color 

interpolation on the digital signal converted by said 
A/D conversion means and generating image data on a 
plurality of color planes; 

color space conversion means for converting a 
10 color space of the plurality of color planes to a color 
space of another colorimetric system; 

separation means for separating image data in the 
color space of another colorimetric system into 
luminance data and hue data; 
15 extraction means for extracting a high frequency 

component from the luminance data separated by said 
separation means; and 

pseudo color removing means for reducing a color 
component generated by said color interpolation means, 
20 in accordance with the high frequency component of the 
luminance data extracted by said extraction means and 
the hue data. 



19 . The image sensing apparatus according to 
25 claim 18, wherein said pseudo color removing means 
comprises : 
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determination means for determining whether or 
not the high frequency component of the luminance data 
and the hue data fall within a color range of the 
pseudo color; and 
5 means for reducing a value of the color 

difference data, determined to be within the color 
range by said determination means . 



20. The image sensing apparatus according to 
10 claim 18, wherein said color space conversion means 

converts the color space to YUV, or Y, R-Y, B-Y, or G, 
R-G, B-G color space. 



21. The image sensing apparatus according to 
15 claim 18, further comprising a low pass filter for 

removing a high frequency component from a color signal, 
from which a pseudo color is removed by said pseudo 
color removing means . 



20 22. The image sensing apparatus according to 

claim 18, wherein the color range of a pseudo color 
includes a color area from red to yellow, and a color 
area from blue to cyan. 



25 23. The image sensing apparatus according to 

claim 18, further comprising isolated point removing 



means for removing an isolated pixel from a hue signal, 
from which the pseudo color is removed by said pseudo 
color removing means . 

5 24 . The image sensing apparatus according to 

claim 23, wherein said isolated point removing means 
includes a median filter. 

25. An image sensing apparatus comprising: 
10 an image sensing device; 

focusing means for focusing into an image on said 
image sensing device; 

A/D conversion means for converting an image 
signal outputted by said image sensing device into a 
15 digital signal; 

color interpolation means for performing color 
interpolation on the digital signal converted by said 
A/D conversion means and generating image data on a 
plurality of color planes; 
20 color space conversion means for converting a 

color space of the plurality of color planes to a color 
space of another colorimetric system; 

separation means for separating image data in the 
color space of another colorimetric system into 
25 luminance data and hue data; 

extraction means for extracting a high frequency 
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component from the luminance data separated by said 
separation means; 

isolated point removing means for removing an 
isolated pixel based on the hue data separated by said 
5 separation means; and 

pseudo color removing means for reducing a color 
component generated by said color interpolation means , 
in accordance with the high frequency component of the 
luminance data extracted by said extraction means and 
10 the hue data from which an isolated pixel is removed by 
said isolated point removing means . 

26. The image sensing apparatus according to 
claim 25, wherein said pseudo color removing means 

15 comprises : 

determination means for determining whether or 
not the high frequency component of the luminance data 
and the hue data fall within a color range of the 
pseudo color component; and 

20 means for reducing a value of the color 

difference data, determined to be within the color 
range by said determination means . 
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27. The image sensing apparatus according to 
claim 25, wherein said color space conversion means 
converts the color space to YUV, or Y, R-Y, B-Y, or G, 



R-G, B-G color space. 

28. The image sensing apparatus according to 
claim 25, further comprising a low pass filter for 

5 removing a high frequency component from a color signal, 
from which a pseudo color is removed by said pseudo 
color removing means . 

29. The image sensing apparatus according to 
10 claim 25, wherein the color range of the pseudo color 

includes a color area from red to yellow, and a color 
area from blue to cyan. 

30. An image processing method for an image 
15 sensing apparatus which includes an image sensing 

device and generates an image signal corresponding to 
an image formed on the image sensing device, 
comprising: 

an A/D conversion step of converting an image 
20 signal outputted by the image sensing device into a 
digital signal; 

a color interpolation step of performing color 
interpolation on the digital signal converted in said 
A/D conversion step and generating image data on a 
25 plurality of color planes; 

a color space conversion step of converting a 
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color space of the plurality of color planes to a color 
space of another colorlmetric system; and 

a pseudo color removing step of reducing a color 
component, generated in said color interpolation step, 
5 by controlling a color difference signal converted in 
said color space conversion step. 

31. The image processing method according to 
claim 30, wherein in said pseudo color removing step, a 

10 value of a pixel of interest is replaced with a 

substantial median pixel value of peripheral pixels of 
the pixel of interest. 

32. The image processing method according to 
15 claim 30, wherein in said pseudo color removing step, 

filtering is performed by a median value filter or 
median filter. 

33. The image processing method according to 
20 claim 30, wherein in said color interpolation step, 

image data is generated in R, G and B planes. 

34. The image processing method according to 
claim 30, wherein in said color space conversion step, 

25 RGB color space is converted to YUV color space. 
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35. The image processing method according to 
claim 30, wherein in said color space conversion step, 
RGB color space is converted to Y, R-Y, B-Y color space 



5 36. The image processing method according to 

claim 30, wherein in said color space conversion step, 
RGB color space is converted to G, R-G, B-G color space 

37. An image processing method for an image 
10 sensing apparatus which includes an image sensing 

device and generates an image signal corresponding to 
an image formed on the image sensing device, 
comprising: 

an A/D conversion step of converting an image 
15 signal outputted by the image sensing device into a 
digital signal; 

a color interpolation step of performing color 
interpolation on the digital signal converted in said 
A/D conversion step and generating image data on a 
20 plurality of color planes; 

a pseudo color removing step of reducing a color 
component included in image data, on which color 
interpolation is performed in said color interpolation 
step; 

25 a color space conversion step of converting a 

color space of the plurality of color planes , where a 
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pseudo color component is reduced in said pseudo color 
removing step, to a color space of another colorimetric 
system; and 

a compression step of compressing image data 
5 where color space is converted in said color space 
conversion step. 

38. The image processing method according to 
claim 37, wherein in said pseudo color removing step, a 

10 value of a pixel of interest is replaced with a 

substantial median pixel value of peripheral pixels of 
the pixel of interest. 

39. The image processing method according to 
15 claim 37, wherein in said pseudo color removing step, 

filtering is performed by a median value filter or 
median filter. 

40. The image processing method according to 
20 claim 37, wherein in said color interpolation step, 

image data is generated in R, G and B planes. 

41. The image processing method according to 
claim 37, wherein in said color space conversion step, 

25 RGB color space is converted to L*a*b* color space, and 
filtering is performed to a* and b* signals in said 
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pseudo color removing step. 



42. _ The image processing method according to 
claim 37, further comprising a conversion step of 
5 converting the signal, processed in said pseudo color 
removing step, into YUV color space. 



43 . The image processing method according to 
claim 37, wherein in said compression step, image data 
10 converted to YUV color space is compressed. 



44. An image processing method for an image 
sensing apparatus which includes an image sensing 
device and generates an image signal corresponding to 
15 an image formed on the image sensing device, 
comprising: 

an A/D conversion step of converting an image 
signal outputted by the image sensing device into a 
digital signal; 

20 a color interpolation step of performing color 

interpolation on the digital signal converted in said 
A/D conversion step and generating image data on a 
plurality of color planes ; 

a separation step of separating the image data in 

25 the plurality of color planes into luminance data and 
color difference data; 



an extraction step of extracting a high frequency 
component from the luminance data separated in said 
separation step; and 

a pseudo color removing step of reducing a color 
5 component generated in said color interpolation step, 
in accordance with the high frequency component of the 
luminance data extracted in said extraction step and 
hue data obtained from the color difference data. 

10 45. The image processing method according to 

claim 44, wherein said pseudo color removing step 
comprises : 

a determination step of determining whether or 
not the high frequency component of the luminance data 
15 and the hue data fall within a color range of the 
pseudo color; and 

a step of reducing a value of the color 
difference data, determined to be within the color 
range in said determination step. 

20 

46. The image processing method according to 
claim 44, further comprising a step of removing a high 
frequency component from a color signal, from which the 
pseudo color is removed in said pseudo color removing 
25 step. 
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47. The image processing method according to 
claim 44, wherein the color range of a pseudo color 
includes a color area from red to yellow, and a color 
area from blue to cyan. 

5 

48 . An image processing method for an image 
sensing apparatus which includes an image sensing 
device and generates an image signal corresponding to 
an image formed on the image sensing device, 

10 comprising: 

an A/D conversion step of converting an image 
signal outputted by the image sensing device into a 
digital signal ; 

a color interpolation step of performing color 
15 interpolation on the digital signal converted in said 
A/D conversion step and generating image data on a 
plurality of color planes; 

a color space conversion step of converting a 
color space of the plurality of color planes to a color 
20 space of another colorimetric system; 

a separation step of separating image data in the 
color space of another colorimetric system into 
luminance data and hue data; 

an extraction step of extracting a high frequency 
25 component from the luminance data separated in said 
separation step; and 
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a pseudo color removing step of reducing a color 
component generated in said color interpolation step, 
in accordance with the high frequency component of the 
luminance data extracted in said extraction step and 
the hue data. 

49. The image processing method according to 
claim 48, wherein said pseudo color removing step 
comprises : 

a determination step of determining whether or 
not the high frequency component of the luminance data 
and the hue data fall within a color range of the 
pseudo color; and 

a step of reducing a value of the color 
difference data, determined to be within the color 
range by said determination step. 

50. The image processing method according to 
claim 48, wherein in said color space conversion step, 
the color space is converted to YUV, or Y, R-Y, B-Y, or 
G, R-G, B-G color space. 

51. The image processing method according to 
claim 48, further comprising a step of removing a high 
frequency component from a color signal, from which the 
pseudo color is removed in said pseudo color removing 
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step. 



52. The image processing step according to 
claim 48, wherein the color range of a pseudo color 
5 component includes a color area from red to yellow, and 
a color area from blue to cyan. 



53. An image processing method for an image 
sensing apparatus which includes an image sensing 
10 device and generates an image signal corresponding to 
an image formed on the image sensing device, 
comprising : 

an A/D conversion step of converting an image 
signal outputted by the image sensing device into a 
15 digital signal; 

a color interpolation step of performing color 
interpolation on the digital signal converted in said 
A/D conversion step and generating image data on a 
plurality of color planes; 
20 a separation step of separating image data in the 

plurality of color planes into luminance data and color 
difference data; 

an extraction step of extracting a high frequency 
component from the luminance data separated in said 
25 separation step; 

a pseudo color removing step of reducing a color 



component generated in said color interpolation step, 
in accordance with the high frequency component of the 
luminance data extracted in said extraction step and 
the hue data obtained from the color difference data; 
5 and 

an isolated point removing step of removing an 
isolated pixel from the hue data, from which a pseudo 
color component is removed in said pseudo color 
removing step. 

10 

54. The image processing method according to 
claim 53, wherein said pseudo color removing step 
comprises : 

a determination step of determining whether or 
15 not the high frequency component of the luminance data 
and the hue data fall within a color range of a pseudo 
color component; and 

a step of reducing a value of the color 
difference data, determined to be within the color 
20 range in said determination step. 

55. The image processing method according to 
claim 53, further comprising a step of removing a high 
frequency component from a color signal, from which the 

25 pseudo color is removed in said pseudo color removing 
step. 
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56. The image processing method according to 
claim 53, wherein the color range of the pseudo color 
component includes a color area from red to yellow, and 
5 a color area from blue to cyan. 



57. An image processing method for an image 
sensing apparatus which includes an image sensing 
device and generates an image signal corresponding to 
10 an image formed on the image sensing device, 
comprising: 

an A/D conversion step of converting an image 

signal outputted by the image sensing device into a 

digital signal; 
15 a color interpolation step of performing color 

interpolation on the digital signal converted in said 

A/D conversion step and generating image data on a 

plurality of color planes; 

a color space conversion step of converting a 
20 color space of the plurality of color planes to a color 

space of another colorimetric system; 

a separation step of separating image data in the 

color space of another colorimetric system into 

luminance data and hue data; 
25 an isolating point removing step of removing an 

isolated pixel based on the hue separated in said 



separation step; 

an extraction step of extracting a high frequency 
component from the luminance data separated in said 
separation step; and 
5 a pseudo color removing step of reducing a color 

component generated in said color interpolation step, 
in accordance with the high frequency component of the 
luminance data extracted in said extraction step and 
the hue data from which an isolated pixel is removed in 
10 said isolated point removing step. 



58. The image processing method according to 
claim 57, wherein said pseudo color removing step 
comprises : 

15 a determination step of determining whether or 

not the high frequency component of the luminance data 
and the hue data fall within a color range of the 
pseudo color; and 

a step of- reducing a value of the color 

20 difference data, determined to be within the color 
range in said determination step. 



59. The image processing method according to 
claim 57, wherein in said color space conversion step, 
25 the color space is converted to YUV, or Y, R-Y, B-Y, or 
G, R-G, B-G color space. 
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60. The image processing method according to 
claim 57, further comprising a step of removing a high 
frequency component from a color signal, from which the 
5 pseudo color is removed in said pseudo color removing 
step. 



61. The image processing method according to 
claim 57, wherein the color range of the pseudo color 
10 component includes a color area from red to yellow, and 
a color area from blue to cyan. 



ABSTRACT OF THE DISCLOSURE 



An image sensing apparatus comprising: a CCD, 
optical system for forming an image on the CCD; A/D 
5 converter for converting an image signal outputted by 
the CCD to a digital signal; color interpolator for 
performing color interpolation on the digital signal 
converted by the A/D converter and generating image 
data on R, G and B color planes; color space converter 

10 for converting RGB color space to YUV colorimetric 
system; and median filter for reducing pseudo color 
components, generated by the color interpolator, by 
controlling color difference signals U and V. By 
cutting high frequency components of the signal, 

15 filtered by the median filter, then thinning out YUV 
signals and performing JPEG compression, pseudo color 
components generated by color interpolation can be 
reduced. 
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